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This report describes the evaluatioji of the T^73-T974 
pistar I and Distar 11 programs, which were nsed as Title I programs 
for "first and second graders^ Distax I was used witfr two first grade 
class.es; Distar II was used with two second grade classes* Children 
"W^ho had completed two years jof Distar instruction received * - 

tradiiiional iiistruction in third grade. The possiiie:- a^flvahtagGs 
(achieveiDent in arithmetic computation) and di§a3,v$nta^:^s (inacl^i^u^t^ 
word-meaning, paragraph-meaning, ana arithmetic; condep-t''skili$i 
development), which were indicated in past comparative analyses of 
the Distar I ai^d II programs, were, reexamined. Findings suggest that^^. 
(1) the Distar program for first graders had no advantage over 
conventional in^struction in developing oral language ability; (2) th$ 
secoTid grade pistar program was strong in spelliiig, word study 
/ skills, and possibly in ar^ithmetic computation; and (3) at the end of 
the third grade., Distar pupils appeared to perform aipproximately at • 
grad^; level with distinct strength in arithmetic computation, 
^ ^ Recommendations, including proposed steps toward redefining Title I 
PPP.ur§itions and programs, are suggested. Appendixes contain data 
* tabjes and other supportive material. (BRT) 
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. . ' ABSTRACT 

D;l3bar^ I v;<vr^ ur>ccl v/ith tv:o first-grade classes • Distar II 
was used with tvjo socond-grado classes* Control groups v;ere se- 
lected at first-, and ""sec end -grades to compare vjith Distar groups • 
Children who had comDlci.cd tvjo years of Distar instruction received, 

_ • ■ 

traditional instruction in third-grade • These chilSi^n v>er compared 
to control' groups* - ' 1^ 

There v/as grov/th in oral language uncl^ca' both Drstar ancL con- * £i 
ventional firstrgrade instruction. First-grade reading results vjere 
inconclusive; the contrql group performed better than one Distar class 
but poorer than another. These children were retcsted^in October 'I97^{' 
ainder standardized . test . procedures.* No significant differences stniong . 
the classes were* then obtained. ' 

One Distar second -grade performed better than a control group' 
in spelling and equally v:ell in six other aress. The other Distar 
^.second-grade performed poorer in several areas than either group 
partially due to transfers of pupils, judged to be better achievers, 
from this group. 

.One Distar bhird-grade peirformed as well as the control group \ 
in four areas tested. The control ?;rbuT) surrassed a second Distar 
third-grade in three ^ireas. Pupils from the latter DisJtar group were 
matched by sex, age, ^^id^I.Q. with third-graders v/ho attended the 
school in 1971* These pupi'is, who received conventional instruction, 
surpassed the .Distar^'pupils, in five of six areas. 

Pupils 'in Distar and conventional programs have an equally . 
favorable attitude tov;ard school. 

These results are compared to results attained in previous years,, 
and general trends are identified. lice c.Vunendab ions, including uro- 
posed steps toward redefining Title I populations and programs, are 
made . » • . ■ • 
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Introduction 

For the past three years the Title I program at WAnthrop con- 
sisted of the use of the Distar program in several first and second- 
grade classes at E.B. Newton school (formerly at Center school) and 
at Chase school (formerly called Shirley Street school). The eval-. 
uation reports for 1971rl972 and 1972-1973 include 'description^ of '• 
the published Distar pi^dgram, reports of research employing the Dis- 
tar program, and, results of the program's use as the Winthrop Title I 
•program. ^ * . . ^ . 

\ln 1971^-1972 the Title I program appeared to produce some gain 
in oral language ability, of one first-grade Distar class. _There 
appeared to be no advantage to Distar instruction over conventional 
instruction in first-grade reading achievement. A second-grade sub- 
group of Distar pupils performed significantly bettei* in arithmetic 
computation than did a similar group given conventional instru6tion. 
All second-graders who had had Distar instruction were cpmpared to 
national norms on. the Stanford Achievement Test and wer,e found to 
be, on the average, significantly below grade placemen,t on four of 
the seven subtests. 

.The 1972-^1973 report concluded that the Distar program conducted 
in that year appeared "to have no advantage over conventional instruc- 
tion in developing oral language ability of first-graders. . Comparison 
of a Distar and non-Distar first-grade class'^'at Newton school in 
reading. achievement showed no significant differences. The first-grade 
Distar class at Shirley Street school appeared to perform better in 
reading than the other two classes. (No differences among these 
groups existed at the time of -testing approximately six months later. 
3ee Appendix and Table A-if). Second-grade Distar.-pupiis for the 
second year scored below grade ley.el on Stanford Achievement subtests 



Qf word meaning, paragraph meaning, and arithmetic concepts. At the 
^end of third grade former Distar pupils did not perform as well in r:. 
reading and arithmetic as their peers who received traditional in- 
struction* The latter probably had higher initial ability* However, 
these third-grade former Distar pupils .now scored above grade . placement 
in arithmetic computation and were not significantly below grade place- 
ment on any Stanford Achievement subtests. Apparently these children 
overcame the significant discrepancy between grade placemeri^t and achievt 
ment- that existed at the. end of second grade on four subtests of the 
Stafford and were performing essentially at grade level in these areas 

after a year of 'convientional instruction. 

, ' ' . . » . . " 

'Judging from the results" obtained in 1971-1972 and 197^-1973 only, 
the use of the Distar program as Winthrop»s Title I program appeared 
to have certain advantages (achievement in arithmetic computation) 
and disadvantages (perhaps temporary, as reflected in second-gre^de 
performance, in word-meaning, paragraph meaning, and arithmetic con- 
cepts). These tentative judgments are reexamined in the present- 
evaluation for 1973-197^. In addition, pupil attitude toward school 
is considered. 

Discussions with Winthrop teachers and administrators suggest 

o 

some differences of opinion concerning the intended population of the 
Distar program. Use of Distar as a <Title I program can be supported 
in part because it is intended for children who are disadvantaged in 
a socio-economic sense. Title I requires that within target areas 
defiiife^- according to socio-economic criteria children who are educa- 
Itional^V handicapped receive service funded by Title I. There is 
disagreement among the school staff as to whether Distar is appro- 
priate for \p€rny[ig disablecL children. The definition and id^ntifi- 
cation of learnfnl disabled children is itself a problem. Apart from-. 
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that, if Distar should pe inappropriate for learning-disabled children, 
it becomes necessary to identify children who are ^ educationally handi- 
capped without being learning disabled and provide only these children 
with the Distar Title -I program. On the other hand^ if the population 
of educationally handicapped children includes or is synonymous with 
the population of learning aisabled children, and the inappropriate- 
ness of Distar for /learning disabled cliildren is demonstrated, it is 
necessary to replace the Distar program with a more appropriate pro- 
gram for learning disabled children* The evaluation report will 
attempt to consider ^hese two points: 1) is Distar appropriate or 
inappropriate for so-called, learning, disabled, children? 2) does the 
population of educationally handicapped children inciude those who 

arie learning disabled?* ^ . 

' . • • . > . 

Description of the 1973-1974 Program 

Distar I was used with one first-grade cla^s at Newton school 
and one first-grade class at Chase school. For purposes of com- 
parison, a control first-grade was selected at Dalrymple school 
(formerly called Highland Street school). 

Distar II was used witih one second-grade class at Newton school 

and one at Chase. Children in these classes had received instruction 

f. ..-< ' ^ 

in Distar I as first graders. A control grpjJiP-,.a.tv<|few;ton/school set 
up in 1972-1973 was continued as a control ] ih 1973-1974. 

Chi;.'dren who completed Distar- II in 1972^1973 entered coiiven- . , , 
tional tfhird-grade classes in 1973-197^. Progress of these children 

was followed;" ' 

■ ' / • 

/It was noted that Distar I instruction at Newton was supple- 
mented by individual tutoring of various kinds given to about one- 

/ - ■ ' 

thiTd of the group. Tutoring was given by remedial reading, learn- 

ing disabilities, or speech specialists. At Chase,' Distar I was 

Supplemented within the .classroom by materials, frpm the Scott- 

/ . ■ 00007 . : . • • : 



F^pre.sman program. Distar II in both schools was typically, supple- ^ 
merited by more conventional materials and instructional procedures. 

Evaluation' Design ^ 

The tvifb first-grade Distar classes and the first-grade control • 
class. at Dalrymple were tested and compared on initial tests of 
readiness, oral language, I.Q., attitude, and on posttests of oral 
language and reading. Pretest' scores of each class are compared 

to their posttest scores for evidence oi ^^rowth in oral language 

, - » 

and, change in attitude. ' ^ 

The two second-grade Distar classes and the second-grade control 
class at Newton school received mid-year tests of reading and I.Q. 
Pre-, and. posttests of attitude were given. An end-of-year standard- 
ized achievement test of arithmetic, reading, and language was given. 
Betweenrgroup comparisons were made and pre-post comparisons of 
attitude were made for each group. 

Af mid-year, parents of first- and second-graders were asked 
to respond to a questionnaire-, concerning their impression of the 
instructional program. Comparisons of responses by parents of 
Distar and non-Distar pupils are made in the Appendix. 

Third-grade former Distar and former control pupils are compared 
on end-of-year performance on a standardized achievement test of 
arithmetic and reading. Third -grade former Distar pupils at Chase 
were matched with children who were in third-grade in 1971 on the 
basis of sex, I.Q., and chronological age at time of testing. Per- 
' formance on a' standardized achievement test by each group is compared 

Tests Used 

. First-grade oral language was measured by means of the Pirst- 
Grade Oral Language Test devised by the evaluator. Development . 
of this test is described in the 1972-1973 report (p. 6). 

• « 
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An evaluator-^esigned reading test was used for midyear 
sepond-grade testing and end-of-year first-grade testing. This 
is a shortened version of the First-Grade Reading Test used in 

d > 0 

6 

prior evaluations • It consists of six selections,, six questions 
on main idea, twelve on stated details, and six: on inferences for 
a total 'of twenty-four items. ] 

Readiness testing Was done with the Mefcropplitan Readiness • 
Test# The Otis-Lennon Mental AblSUty Tes/ was used for IQ 
measurement • The Stanford AchievemerrcTest, Primary II, was used 
for end-of-year testing of secorid and third-graders^ The attitude 
measiare was When Do I Smile? Lower Elementary Level, published by 
American. Institutes for Research." 

8 > . \ 

Oral Language 

Table 1 shows the first-grade Dis^tar class at Newton school^ 
and the first-grade control class at Dalrymple made significant 
gains in oral language ability as measured on the Oral Language 
Test# The Distax^ class at Newton arid the control class both per- 
formed significantly better on the posttest than the first-grade 
class at Chase* Thiss is shown in Table 2. A comparison of these 
three groups on the .pretest is made in Table A-3* Differences in 
' number of children ^tested in any one school as shown on the three 
tables result from the fact that a child may have been present 
for one test but riot for another • Table 1 includes only those 
"children both pre- and posttested# This variation requires that 
any comparis^on^ of results from one table to another be made with 
caution^ , , 
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TABLE' 1 



PRETEST AfID POSTTEST RESULTS ON THE 
FIRST-GRADE DEAL LANGUAGE TEST 



Oroup 


N 


Pretest 
Mean & 
SD 


« Posttest 
Mean & . 
SD 


t 


P 


Dlstar-Newton 


21 


7.86 " 


10.62 


3.610' 


<.01 






2.61 ■ 


2.50 






Ptstar-Chase 


18 




7. .61 


-1.056 


NS 






2.23 


3.36 






C6ntl*ol-Dalrym • 


20 


10.10 


11.50 


. 3.339 


<.01 




2.61 


2.37 







NS = Not Significant 



TABLE 2 ' 

comparison op oral language posttest 
"scores op first-graders . 



Grwp 


N 


Mean 




SD 




.P 


■ Newt on-Di star 


22 


10.73 




2A9 






VSi ' 








3.573 


° <.001 


Chase-Distar 


20 


7.55 




3.25 






.Newton-Distar 


22 


10.73 




2.49 






vs. 








-0.857 


NS 


Dalrym.-Contr. 


23 


11.35 




2.37 






Chase-Distar 


20 


7.55 




3.25 


-^.418 




■ vs. 








<.001 


Dalrym.Contr. 


23 


11.35 




2.37 






NS = Not Significant 



First-Grade Reading 
Although many significant differences appear in a coraparisbn • 
of the three first-grade classes with one-another in reading ability, 
from the standpoint of judging. the effectiveness of the Distar pro- 
gram, results are inconclusive and ambiguous* The reason for this 
is the marked disparity in performance of the two Distar classes. ^ 
As shown in Table 3, performance of the Distar class at Chase was ^' 
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decidedly superior to, that at Newton, Wot only are the raeians of 
th6 Chase group higher but the spread of scores, as measured by . 
the standard deviation, is consistently smaller. This fact ts 
also illustrated in Table 4, The same results were obtained when 
■comiparing Chase with the control group. There are several possible 
explanations for this result; 

Eleven of the twenty-one children at Newton are receiving 
sup: 'leraentary remedial" reading or learning- disability help, or have 
been identified for such help in the future. It is possible that ' 
this is disproportionately large,, compared to the other two classes, 
making for a basically dissimilar group with lower achievement poten- 

tial. . . , 

A large number of the test papers at Newton were incorrectly ^ 
marked. There were numerous omissions, multiply-marked answers, or 
marks in wrong places (other than choices in the multiple-choice 
questions). Similarly, these children failed to mark the' Smile . pre- 
test correctl'y, resulting in the invalidation of that instrument for 

> 

many children. These observations suggest either that the children 
were very inunature and unable to learn the mechanics of responding 
to paper and pencil instruments, or that they were poorly supervised 
during the testing sessions. ^ ' . 

o 

The instructional program conducted at Chase differed from 
that at Newton by combining many aspects of the Scott-Pore sman pro- 
gram with' the Distar program. The results that .were obtained may 
be due t.o this fact, in which case such a combination program must 
be superior to Distar alone and Scott-1?oresman as practiced in the 
contro?.' group. On the other hand, it is necessary .to recall the 
results of the program in 1972-1973» The first-grade at Chase 
apparently did extremely well at that time. With few changes, 
these- children as second-graders are compared to second-graders 

i ■ • ■ • 

at Newton on the New Pirst-Grade Reading Test administered . in 

QMJJ . •■ ■ ^ 



Discember 1973 • These results appe^ar in Table A^k\, It can be seen 
that despite apparent differences at the end of first-grade, there : , 
are no significant differences favoring the Chase pupils six raonthsi 

• ; ^ \ 

later* If the apparently superior achievement of the first-graders; 
at .Chase is, likewise, not retained in six month's time, the educt: - 
tional importance of this difference must be questioned* 

Finally, the^ possibility that children at Chas«riierQ inadyert- 
ently coached as teachers supervised the mechanics of test admifiistra 

tion cannot be ruled out* Inadvertent coaching at Chase along with 

' \ ^ ^ 

poor supervision at Newton could explain the large differences In 
test performance*. , 

"^Several recommendations are in order: 1) Assuming the superior^ 

. ' ■ ; .\ 

test performance at Chaise reflects superior reading ability, the '\ 

. ■ _ * ' / . \ . 

second-grade tjBacher of these children- should be encouraged to \ 
support their continuous growth* 2) If there were differences in 
the kinds of test supervision among the three classes, futijor.e group 
tests of first-graders should be administered by the same examiner 
team, perhaps consisting of a remedial reading teacher or readilig 
supervisor trained to administer group tests assisted by aides* 
3)- To check on maintenance of performance level, the same group test 
should be administered to these children when they are in second- 
grade in the fall of 197^. 



TABLE .3 

# 

comparison op reading scores on ' 
new; distar 'reading ^est 
• . for first graders - - - 



Sc.Q5e____^ 


Newton-Distar 


Chase-Distar 

( N = 19') ■ 
Mean & SD 


. . t 






^.(JL^ 21) 

Mean &'~SD — — 






, o 

.Main Idea 


1.2^ • 
1.73 


4:.32- 
,lill 


. 0 


— <^001- 


Details 

\ 


1.81. 
2.52 


10.16 . 
1.^2 


-12.701 


V.ooi 


i 

Inferences 


0.86_^- 
1.35 


3.68 
1.25- 


-6.84^ 


<.001 


Total Heading * 


. 3.96 
if.if9 


18;16 


-12.308 


<.001 




Newton-Distar . 

(N='21) 
Mean' & SD 


Dalryra.-Contr. 

(N = 23) 
Mean & SD 






Main Idea 

o 


1.2^ 
1.73 


2.91 
1.56 


-3.374 


<.01 


Details 


1.81 
2.52 


6.52 
3.01 


-5.596 


<.06l 


Inferences 


■ 0.86 

1.35 

■fi 

3..9O ' 


3.13 
1.^2 


-5.418 


<.001 


Total Reading 


. 12.57 . 
^,.97 


-6.041 


<.001 




ChaserDistar 
-.(N = 19) 
Mean & SD • 


Dalrym.-Contr. 

(N = 23) 
Mean & SD 




- 


Main Idea 


^.32 
1.11 


2.91. 
1.56 


3.284 


<.01 


Details 


10.16 
1.^2 


6.52 
1 3.01 


4.826 


<.001 


Inferences 


3.6.8 
1.25 


3.13 
1.^2 


1.325 

0 


NS 


Total Reading 


18^6 


12.57 
^.97 


4.481 


<,ooi 



-NS'^ Not Significant 



TABLE k ' 

FREQUENCY DISTRIBUTION OP SCORES ON 
FIRST-GRADE READING, TEST 





Scores 


Newton 

- - - _ — 


Chase . 
f 


Dalrym^ 
f 


Main Idea 


5-6 


- o 




• ... 5 






J ■ 


lb 


' B - 








0 


' 11 


Details ^ 


9f-^ 3.2 


1 


lo 






P o 


j J. O 


J. 


10 




0 - U 


Xy 


•V 


7 • 


inferences . 


5 6 ' 


0 


5 ' 


2 ■ 




'3 - 


3 


9 






6 - 2 


18 


S 


7 


Total Reading 


17 -■ 2^^ 


1 


13 • 


6 




9-16 


1 


6 


13 




0-8 


19 


. 0 • 


5' 



Secpnd-Grade Achievement 
The interim report (Appendix) shows that the three second-grade 
classes were essentially equivalent in reading ability in December . 
as measiired on the new form of the evaluator-constructed Distar 
Reading Test.- Only one difference was found between the Newton 
Distar class and the Chas§ Distar class favoring the former. Of a 
possible score of 2^, Table k-A shows the Newton Distar group attained 
a total mean score of 19.87, the Chase Distar group attained a total 
mean score of 18.16, and ^he Newton Control group a total mean score 
of 18.23. 

These groups were again tested in. May 197^. Membership in the 
groups was not identical from December to May in that a few children 
were tested on one occasion but not on the other. It should be noted 
ifchat three children included at Chase in the December testing had been 
transferred to traditional classes at the beginning of the school year 



These children are not included in the May testing. 

" ' ■ f ' . - 

Table 5 compares the three groups on the Stanford Achievement 

Test, Primary II, subtests of Word Meaning, Pai'agraph Meaning, 

Spelliiag, Word Study Skills, Language, Arithmetic Computation, ' and . . 

Arithmetic Concepts.* Subtests of Spelling arid Language were not 

administered at Chase school; no corai>arisons with Chase can be made 

f or .tHese ^reas. Subtest comparisons are presented in Table 5» 

. As was stated in the 1972-1973 report, the control group was 

- _ _ selected In such a manner as to permit comparisons with the Distar . 

group at Newton school. Furthermore, additional changes in the Chase 
school group, including movement of three students who achieved well 
into traditional programs, make inappropriate any evaluative judg- 
ments involving ^Chase school in the comparison made on Table 5# I'he 
data permit one to assess only the present status of the Chase school 
group without inferring anything about, the effectiveness of the in- 
structional program. On this basis it can be seen that the Chase 
school grpup at the end of the' second grade consisted of children who 
^ performed .poorer in word meaning, paragraph meaning, and word study 
skills th-an children in each of- the other two groups. 

Comparison of Distar and Control groups at Newton school shows 
> the former performed significantly better on the' spelling subtest. 
There were no other significant differences between the two groups* 
It can be concluded that the Distar program at Newton school was at 
least as e^'fective as the conventional program for these children* 
The Distar program evidently produced superior results in spelling. 

^Grade equivalent scores on the Stanford subtests were compared 
to a gr.ade placement norjn of 2#9#^ As shown, in '^able 6, the Newton 
school Distar class performed' significantly better than the national 
norms in spelling and word study skills; the Newton school control 
class scored significantly below national norms in language; the 

ERXC Chase school Distar class scored significantly below national norms 

~" . - . ■ ' . '3.0015- ' - 
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in word meaning, paragraph meani'nig, and word study skills. 



TABLE 5 

COMPARISON OP DISTAR AND NON-DISTAR PUPILS 
ON STANFORD ACHIEVEMENT TfiST 
PRIMARY II, FORM W (MAY ,197^^) 



TQSt 


Newton Distar 
Mean & N 
SD 


Chase Distar 
Mean & N v 
SD 


t 


P 


Word Meaning 


2i?3 
.67 


23 


2.29 
.50 


15 




■ X.di 

/■ • ■ 


Para.- Meaning 


2.80 
.•77 


23 


2.19 


15 


2.755 


<,01, 


Word' St. Skiais 3.70 
' ■ ^ . . . ' ' 1.52, 


23 


.69 


14 > 


--^2.786 


<.01 


j&gith. Cdmpu; • 


3.03 
.51 


23 


.3.00"^'^ 
• ... .21. 


13 


0,175 


• ' NS . 


Ari|h« Concept 


2.92 




2.67 . 


13 • 


a.!322 


NS'" 




1.03 




. -.53 










Newton D\star 
Mean & N 
SD 


Newton Control 
Mean & • N 
SD 




■ - 


Word Meaning 


2.93 
.67^ 


23 


2.9^ 
.55 


27 . 


-0.035 


NS 


Para. Meaning 


2.80 . 
.77 


23 


2.89 
. .57 


•27 


. -0.487 


NS . 


■Spelling 


3.31 
. .62 


23 


2.73 

- ^57 


27 


3.471 
0.470 


<.01 


Word St. Skills 


3.70 
1.52 


. 23 


3*^9 
1.58 


27 


NS ■ 


Language 


2.97 
.8i^ 


23 


2.63 


27 


1.579 


NS' 


Arith. porapu. 


3.03 
.51 


23 


2.74 
.53 


27 


1.929 


■ NS 


Arith. Concept 


2.92 
1.03 


23 . 


2.74 
.87 


27 


0.697. 


NS 
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Test 



Chase 
Mean 

c r\ 


•Distar 
& N 


Newton Control 
Mean & N 
SD 


2.29 


r 

15 


2.9^ 


' 27 


.50 








2.19 




2.89 


27~ 






.57 




.2.^9 


lit 


3.^9 


27. 


.p9 




1.-58. 

0 




3.00 


13 


2. .7^ 


27 


■ .21. 




.53 




2.67 


13 


2.7^ 


27 


.53 




• .87 





-3,780 ■ <.001 
-^.09^ "<-.Q01 
'2,21^ <.05 
1.692 NS 
-0.258 • NS 



NS =' Not Significant 



TABLE 6 ■ 

COMPARISON OP STANFORD ACHIEVEMENT SUBTEST SCORES 
TO GRADE PLACEIffiNT NORM OF 2.9 • 



Test 


Newton Distar 
Mean & N 
SD 


P , 


Chase 
Mean & 
SD 


Distar 

■ N P 


Newton 
Mean & 
SD 


Contr. 

, N P 


Word Meaning 


1 

2.93 


23 


NS 


2.29 


15 


<.001 


2.9^ 


27 


NS 


.67 






.50 






-.55 






Para.. Meaning 


2.80 


23 


NS ' 


2.19 


15 


<.001 


2.89 


27 


NS 


.77 






.^7 






'.57 






Spelling, 


3.31 


23 


<.01 








2.73 


27 


NS " 


.62 












.57 






Word-St. Skills 


3^70 


23 


<.05 


2.^1-9 


lif 


. <.05 ■ 


3M 


27 


NS 




1.52 




.69 






1.58 






Language 


2.97 


23- 


NS 










27 


<.05 


.8k 


















Arith. Compu. 


3.03 


23 


NS 


3.00 


13 


NS 


2.7^ 


27 


.NS • ■ 




.51 






.21 






.53 






Arithi Concept 


2.92 


23 


NS 


2.67 


13 . 


NS 


'2.74 


27 


NS 




1.03 






•53, 






.87 







NS = Not Simificant. This comparison employed t test for single mean. 
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Third-Grade Achievement 

Third-grade former Distar. pupils from Newton and Chase schools 
and former control pupils at Dalrymp]^ (Highland Street) were compared 
on results of system-Wide testing on the= Stanford Achievement Primary 
II Form W, These pupils were among those' in the second-grade group. . 
• evaluated in 1972-1973 • Distar pupils were not . com})ined^s,.one group, 
as^done in 1972-1973, reveal possible dilFferences between the two 
'former Distar classes at the present " time • 

Ail children included in this analysis ^were tested on the word 
ineariing,' paragraph meaning, arithmetic computation, and arithmetic 
concepts subtests of the Stanford* Results;* of the; comparison are 
presented in Table 7» Table 7 reveals that several . significant 
differences appear* between the two former Distar groups, favoring 
the group from Newton school. No differences were obtained ]between 
the .Newton Distar group' and the Dalryraple controls, but the compari- 
son of the Dalryraple controls with the Chase school former, Distar 
pupils revealed significant differences favoring tlje former in word . 
. meaning and paragraph meaning. 

These results were not inconsistent with the second/-grade com- 
parison of 1972-1973 in which essentially the same children were 
compared. In that qor^^parison the control group was favored in word 
meaning and word study skills. Evidently, the particular Distar 
school has some influence on performance. Newtbn school attained 
bet^ter results in the present year's third grade and second grade 
than children at Chase. This may reflect differences in first-grade 
selection policy, in policy for transferring children from Distar to 
traditional programs in second-grade on the basis of superior first- 
grade performance, axiu. *n quality of instruction in Distar classes^ 
in grades one and two and in post-Distar clas.ses in grade three. 



00 018 



-15- 



TABLE 7 ■ 

COMPARISON OP THIRD GRADE P&HI-IER DISTAR & CONTROL PUPILS 
ON STANFORD ACHIEVEMENT TEST, PRIMARY II, FORM W • 

(APRIL 197^) ■ 



Test 


Newton Distar 
Mean & N ■ 
SD 


Chase Distar 
Mean & N 
SD 


t 


P 


Word Meaning 


3.78 
■ .59 


18 


3.16 
.81 


. 23 


2.732 


<.pi- 


Para. Meaning 


3.71 
.73 


18 


2.89 
.93 


23 


3.052 


<.01 


Arithi Compu. , 


.81 ^ 


18 

\ 

\ . * 


3.80 
1.22 


23 


1.835 


NS 


Arith. Concept 




18 . 


3.25 . 
1.02 ■ 


•23 


2.758 


<.01 




Newton 
Mean & 
SD 


Distar 
N 


Dalrym. 

Mean & 
SD 


Contr. 

N 






Word Meaning 


3.78 
.59 ^ 


18 


3.92 
.82 


13 


-0.552 


NS 

# 


Para. Meaning.. 


,3.71 

>73 




3.53 
.55 


13 


0.728. 


NS . 


Aitith. Compu. 

1 

/ 


.81 


18 


.71 


13 


1.113 


NS 


Arith^. Concept 


■ .75 


18 


3.75 
1.18 


13 


0.837 


NS 




Chase Distar . 
■ Mean & N 
SD ' 


Dalrym. 
Mean & 
SD 


Contr. 

N . 






Word' Meanings - 


3.16 
.81 


23 


t 

3.92 
.82 




-2.692 


<.0'5 


Para* Meaning 


2.89 
.93 


23 


3.53 
.55 


13 . 


-2.259 


<.05 


Arith# Compu • 


3.80 
1.22 


23 ■ /' 


il-.lO 
.71 


13 


-0.811 


NS 


Arith* Concept 


3.25 
1.02 


23 

1 


3.75 - 
1.18 - 


_ 1-3- - 


-1.335 


NS 
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* Mean subtest scores of third graders were' compared to grade 
expectancy riorm of 3.7. This comparison (Table 8) shows. that the 
Newton school Distar group significantly surpassed the norm of 3.«7 
in arithmetic computation. The Chase school Distar group scored' 
significantly below, the expected score of 3.7 ^.in word meaning, 
paragraph mean^^ig, and arithmetic concepts. The single area of 
success for both groups, then, was arithmetic caoaputation. The 

Dalrymple school control, group scored approximately at the national 

i • - • 

norm of 3.7 in all areas tested. 



/ 



. ■ TABLE 8 . ^ ^■ 

COMPARISON OP STANFORD ACHIEVEMENT SUBTEST SCORES 
TO GRADE PLACEMENT NORM OP 3.7 



Test • ^ 


Newton Distar 
N = 18 

Mean & SD P 


Chase Distar 

N .= 23" 
llean & SD 


P 


Dalrym. Contr. 

N =■ 1-3 

Mean &* SD P 


Word Meaning 


3.78 
■ .59 


NS 


3.16. 
.81" 


<.-01 . 


3.92 NS 
.82 


Para. Meaning 


3.71 
*73 


NS 


'<93 


<.O01 


3.-53 ■ :NS/ 
.55 7 


Arith. Compu* , 


.81><^ " 


"<.01 


3.80 
1.22 


NS 


i^-.lO NS" 
.71 / 


Arith. Concepts 


^^^'^ 
•7.5 


NS 


3.25 
1.02 


<.05 


3.75- ■ /NS. 
1.18 ■ / . 



Matched Third Graders at Chase School 
It was the impression of the principal at Chase school that /the 
Distar program was more successful than the conventional program' when 
used with children thought to have potential learning ^ohlemsj! This 
expectation was evaluated in two ways. First, a cursory eljcamination 
was made of first and second grade results on the Gates-MacGinitie 
reading tests, which are used regularly at that school. The first-, 
grade Distar class obtained a mean score of 1.9 in vocabulary and 1.6 
in comprehension. These were lower than mean scores obta,ined by the 



^ other two f irst-grade^Ias.ses. The second, grade Distap class obtained 
j •^ mean .scores bf-'S^ in vocabulary and 2.0 in comprehension. These, too,. 



')wer''than the mean scores of the other two second-grade classes. 





ERIC 



These results indicate the childre^ selected for Distar instruction 



at Chase school do not per*f orm as well as other children, at Chase 
school • This may be due tb the selection process for Distar; children 
who are judged, to have learning probiems are perhaps more often 
selected. Also,^.childi»en who achieve well in f irst-ffrade are often . 
not retained in Distar in second-grade, thereby reducing the mean - - ^ 
achievement of that group* In any event, the Distar program has not 
enabled children* selected for the program to achieve as well as other 
children in the grade. The major criterion for judging the success 
of the effort, however, is whether children, selected for the pro- 
gram perform better in the program than they would perjPorm in the ^ 
alternative, conventional program. The second step was- taken in < 
an effort to answer this question* 

An attempt was made, to match the twenty-three former Distar- 
third-graders (whose results*" on four Stanford subtests are reported 
in the preceding section of this ij'eport) with third-graders in 1971 
who had ..proceeded through aj^onventional instructional prograrn. 
One child had not started Distar in September of the first-grade. 
Of the remaining twenty-two :chi*ldren, eighteen were successfully 
matched with children from^ hree third-grade classes at Chase in 
1971 on thelfeasis of , sex, l^.Q. (second-grade administration of the 
Otis) .withifi-Vive I.Q. points, and chronological age (at time of 
I.Q. testin|g)\within six months. The matched groups, were then com- 
pared^ on six Stanford subtests using the t test for correlated 
observations. lAs shown on Table 9, the two^groups did not differ 
"in I.Q. and chrpnological age (at time of testing), therefore, 
they were successfully matched. The non-Distar group, achieved better 
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^than the Distar group on subtests of word meaning-, paragraph 
meaning, arithmetic concepts, word study skills, and spelling. 
The groups did not differ significantly in arithmetic computation. 
This procedure of analysis was followed in order to judge kow 
well Distar children might have performed under the conventional 
instructional program. It is possible that, despite the effort 
of matching, the control group was not comparable. The basis 
for selection of children, in the fir^t place, for Distal instruc- ' 
tion" is not Known. First-grade readiness scores of the two groups 
were not examined and may differ. The assumption .of similarity 
be,tween groups On the basis of second grade I.Q. was made. In 
any event, the evidence at this time does not support the likelihood 
^that the third-grade children at Chase school who had been selected 
for Distar instruction achieved any better than they would have 

achieved in a conventional pro^^am of instruction.- 

■ ■ 1 ■ \ 

' TABLE 9 

COMPARISON OP EIGHTEEN PAIRS OP DISTAR THIRD-GRADERS IN 19?^^ 
^ AND KQN-DISTAR THIRD GRADERS IN 1971 AT . CHASE7 SCHOOL 



Distar Non-Distar t . . P 
Mean & SD Mean & SD 



Age in moa. 108.06 108. 33 0.424 NS 

at time of .IQ 3.69 3.46 
test 



I.Q. . 


101.17 
10.39 ' 


100.89 
9.68 


-0.417 NS 


Stanford Achievement 
Prim. II, W 
Subtest Scores 






Word. Mng* 


3.32 
.76 


4.18 
•59 


3.806 <.01 


Para. Mng» 


3.08 
.95 


4.12 
.61 


• 4.441 <.001 


Arith. Comp. 


3.99 
.98 


.4.12 ■ 
.73 


0.442 NS 



-19r . . 
TABLE 9 (CONTINUED) 



Distar- 
Mean- & SD 



Non-Dis.tar t 
Mean & SD 



Arith. Cone. 3«42 
* . . 1.03 

Wd.St. Sk. 3.68 
1.61 



Spelling/ 



3.^*8 
.88 



.90 

5.22 
1.50 

1.05 



2.370" <.05 
2.785 <.05 
2.560 <.05 
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NS = Not Significant 



^ •• ■ ■ / • • • ... 

Pupil Attitude ^ 

It vfas cpnsidei*ed possible that participation in the Distar 

program would have some beneficial effect upon ;a pupil's attitude. 

toward school, which reflects /to. some extent ai pupil's- self-cpncept. 

The instrument When Do I Smile? Lower Elementary Level (American 

• / ' ■ / ,. y 

-Institutes for Research) was selected to measure attitude. Pretesting 
was ddhe in November 1973. A' comparison of first-grade classes 

and Second-grade classes is presented in the/ Appendix (Table A-5). 

f / ■ I 'I 

A t/ompai*ison' of the first-grade Distar class at Chase with the 

f irstrgrade control class at Dalrymple showed the latter^pup- 

hLl a: more favorable a/tltude ^( lower mean /score)-^ the. pretest. 



A comparison pf postt.est-'Scores showe' no significant dif fer- 

Bnces between^aTiirlbwo'first-grades or between any two second-grades 

;see Table 10). Comparisons pf pretest^with posttest results for 

each group is made in Table 11. As shown there, a significant = 

chanjje "toward a less favorable attitude occurred in the first-grade 

control group. However, as shown in Table 10, this group (of twentyr 

three children on the pos'trtest compared to nineteen of the same 

children in the pre-post comparison) did not have a less favorable 

attitude than either of, the Distar groups on the posttest. In con-.- 

elusion, the Distar program did not produce either a more or a less 

favorable attitude toward cchopl than a conventional instructional 

0 0 023 



-20- 



program< 



The Smile instrument has a possible raw score range of 21 to 105, 



A score of < 6.3 would result from expressions of favorable attitude- 
It can be se^ that all mean scores reported, in Tables 10 and 11 
-Indicate favorable attitudes toward school. ' • 



TABLE 10 

COMPARISON OP GROUPS ON ATTITUDE MEASURE 
WHEN -DO I SMILE? POSTTEST ( MAY, 197^) . ' 



/ 



GrouD 


N 


Mean 


SD 




• P / , : • 






Grade 1 




/ 


Newton-Distar 
vs. 

Chase-Distar 


.17 
17 


37.^1 


12.02 
11.93 • 


-1.903 

» > 


. i 

NS 


Newton-Dlstar 
vs. 

Dalrym.-Contr. 


17 
23 


37.^1 
■ ^3.57 


12.02 
11.821 


-1.616 


NS 


Chase-Distar 
vs. 

Dalrym..-Goritr. . 


17^ 

"^3 


^3.^7 ' 


'11.03 
11.82 


' 0.37^ 


NS 


Grade 2- ■ 


Newton-Dlstar 
vs. 

GhaserDistar 


22 
15 


37.55 


• 8.81 
12.37 


-1.166 


NS 

i 


Newton-Dlstar 
vs. 

NewtonrContr^ 


22 
25 


38'. 12 


8.81 
.6.81 


-0i252 


NS 


Chase-Distar 
vs. 

Newton-Contr. 


15 
25 


^■1.60 
38.12 


12.37' 
6.81 


1.151 


NS- 



NS = Not Significant 

Lower scores Indicate more-favorable attitude 
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• TABLE. 11 

PRETEST AND POSTTEST RESULTS ON THiS 
ATTITUDE MEASURE WHEN DO I SMILE? 



Group 




Pretest 
Mean & 
SD . 


Posttest 
Mean & 

. SD 


t 




Grade 1 ^ 


Newt on-Di star 


9 


39i22 
17.73 


38.33 
13.89. 


' '. -0.139 


' NS 


Ghase-Distar 


16 


12.17 


^5.19 
11 '.3^ 


0.188 


NS 



.Dalryra.-Contr. 19 32.8if . k2,7^ 2.903 <.01 

10.08 ■• 11.63 



Grade 2 



Newton-Distar 21' 3».95 37.1^ 

. ' " 12i'^91 8.82 

Chase-Distar 13 40.86 ' 41.86 

9.21 .12.80 

Newton-Contr. 23 39.09 38.43 

9.65 7.01 

NS = Not Significant ^^-^ 7 
Negative t value indicates sT f}i-V^ ho -more favorable attitude. — 
. ■ \ '' 't ■ 



Summary of Results - 

• 1.' The Distar first-grade at Newton school and the first-grade ■ 
control at Dalryrapie made significant gains in oral language. The 
two classes performed better on the posttest than the Distar first- 
grade at Chase. 

2. The control first-grade at Dalryrapie performed better than, 
the Distar f irst-gradis at Newton but poorer than the Distar first- 
grade at Chase. Several possible explanations for this result are 
discussed, including that of error in test administration. 

3, The Newton-Distar second grade performed better than the 
Newton-Control second grade on the spelling subtest of the Stanford 
Achievement. There were no differences between these two groups. 

ERIC on six other subtests. The Chase school Distar class, partly due 

• - • • • ' o -Oj[>.2 ^ ■ 



-0.648 NS 



0.317 NS 



.-0.306 NS 



to interclass transfers, consisted of children who performed poorer 
in wT^d meaning, paragraph meaning and word study skills ,than the 
other groups. " * . ^ 

^ The Newton-Distar second-grade surpassed the grade placement 

norm of 2.9 in spelling and word study skills* The Newton-controi 
.second-grade class scored below grade placement in language* The 
Chase-Distar secondr^ade sewed below the national norm in word' 
meaning, .paragraph meaning, and word stuSly skills. 

* S: The Newton^ Pistar third-grade ar4 Dalrymple control 
third-gra did not differ significantly on four Stanford Achievement 
subtests. The former surpassed the Chase former Distar third-grade*';^ 
In word -meaning, paragraph meaning, and arithmetic concepts. The 
Dalrymple control surpassed Chase in word meaning €md paragraph 
meaning. 

• 6. The Newton former Distar third-grade surpassed the natironal 
norm of 3.7 in arithmetic computatip|i. The Chase former^ Distar 
third-grade fell significantly below the norm in word meaning, para- 
graph meaning, and arithmetic concepts. 

'it 

7. Eighteen. third-grade former Distar pupils at Chase were . 
matched with children who were third-graders in 1971 for sex, I*.Q., 

^and chronological age (vfhen tested). The former Distar pupils scored 
significantly ^'below the others in five of six Stanford 'Achievement, 
subtests. 

8. First- and second-grade Distar and control- classes showed, 
on the average, favorable school attitude. There was a significant 
shift toward a less favorable attitude in the f irst-g'r^ado control, 
class, ^ but neither 1;he first-grade classes nor the aecond-grade 
classes differed significantly on the post-tested attitude measure. 



Cohbluslons * . v / 

!• There was evidence of growth in oral language ability under 
both Distar and conventional first-grade instruction. Over the past 
three years there is growing evidence that the Distar program has 
no advantage over conventional instruction in developing oral .lan- 
guage ability of fir St -graders. 

. 2. For jbhe second year, performance of first-graders at Chase 
r surpassed other first-graders in reading. The first-graders in 
1972-1973 did not maintain this advantage. It is not clear whether 
the difference is due to features of the Distar .instructional program 
at Chase, error in test administration procedures, or some^ther 
reason. Unlike past years, the first-grade Distar class at Newton 
school performed poorer in reading, than the control group. There 
was. evidence that ^th^ children in the Newton group were ^nsuf f i- 
ciently supervised on the reading "test and on the a'ttitude pretest . 
Also, a substantial number of the Newton school children. had been 
identified as having learning disabilities. It appears likely,, 
judging from test results and teacher^obgervations, that a popur 
lation so identified fails to achieve well in a Distar program and 
requires some alternative instructional program. 

.3. At second-grade level Distar pupils appear to do as well 
as their peers of similar initial ability in control groups. Second 
graders^ in Diistar, when pupils of higher ability are retained in 
Distar classes, have .begun to score at and above national norms 

o 

for their grade placement. At second-grade level, distinct strengths 
of such a Distar group (as was found in Newton school) seem to lie 
in^pelling, word study skills, and possibly in arithmetic computa- 
tion. 



4. Third-graders who had Distar instruction in the, first one 
or two grades appear to differ depending on their school. Forraer:* 
Distar pupils at Newton evidently achieve better than those at 
Chase in several areas. Distar pupils at Newton in 1973'^197^ 
"perforitt as well as children who had proceeded through conventional 
prosrami?- of instruction. The Newton school former Distar group 

surpassed national norms in arithmetic computation and were at grade 

*» 

.level in other areas. Except for the current year's third-grade 
at Chase, Distar .pupils appear to perform approximately at grade 
'devel by the end of third-grade with a distinct strength in arith- 
metic xsompu tat ion. Pupils at Chase of comparable KQ. appear to 
have performed better after three years of conventional instruction. 

5. Pupils in Distar and conventional programs appear to have 
an equally favorable attitude toward school. 

' Recommendations 

1. Largely to check on the ambiguous status of first-grade 

readihg results, the same children should be re tested on the same 

« 

reading test in the fall of 1974 with safeguards to assure comparable 
procedures of test administration. 

2'. Eoulvalent criteria should be established for both target , 
schools (Chase and Newton)' to employ in selecting children for Title 
I service on the basis of educational handicap. This is especially 
important for pre-f irst-graders, where achievement data is lackiiig. 
Within this group of educationally handicapped children are those 
who have been referreci to as lesirning disabled. Criteria for the 
definition and identification of this subgroup should be established. 
Since it is likely that all educationally handicapped children do 
not benefit from the Distar instructional ^)rogram, the Winthrop 
schools should begin to use Title I funds to support a broader 
range of instructional services. Instruction should be differentiated 

.00 028 



■according to the characteristics of the learner. The form of 
instruction provided to a child should be continued only if prog- 
ress day-by-day is actually observed* . It is unnecessary to wait 
until end-of-year evaluation to make such a judgment* 

3. To implement the recommendations in paragraph (2), the 
j school department should a) conduct a needs assessment, b) establish 
i criteria for the selection of children for Title I service on the 
basis of educational .handicap, c) establish a range of instructional 
services related to the types of .educational handicap identified 
within the population, d) establish a set .of learning goals of a . . 
highly specific type so that day-to-day progress can be evaluated, 
e) identify, by name, the children who will receive Title I service 
-•Annually, f ) justify, on the basis of objective and generally ac- 
cepted criteria, non- inclusion of a child who had received Title I 
service the previous year* 

4* The Distair program should be used only with those children 
who are observed to progress under it on a regular basis. The pro- 
gram, should be supplemented so that a wider range of reading and writ- 

ing activities will be possible. There should be increased opportu- , 

1 

nity to develop comprehension through the reading: of stories and 
factual articles, greater exposure to literature, and increased 
opportunity to write and read about experiences shared by the children. 

5. All children should have the opportunity to use the materials 
of many-faceted basic reading systems that are now being introduced 
into the schools. 
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APPENDIX A 



Interim kvaluat^ion of the 1973-197^ 
Title I Program of 
Winthrop, Massachusetts 



Maurice Kaufman, Ph.D. 
Boston 
1974 ■ 
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The testing of first-graders to date was de'signed for two 
purposes: 1) to. describe arid compare the Distar and Control 
groups with respect to IQ, readiness, and oral language ability; 
2) to establish a baseline. for future growth in oral language ability • 

Examination of Table A-1 shows that the twoj first-grade Distar • 
classes are approximately equal in IQ. The first-grade conj^rol 
class at Dalrymple School is superior to one of the Distar classes* . 
This superiority may reflect a difference in native ability or it 
may reflect a deficiency in performance of the Distar children 
that is a direct result of the socio-economiQ. deprivation whose 
effects on academic performance the Title I program proposes to 
overcome. ^ • 

Similarly, the Dalrymple group was superior to the two Distar 
classes on the Metropolitan Readiness Test (Table A-2). The two 
-Distar groups did not differ significantly in readiness. 

The Oral Language Test was 'used for the purpose of comparing 
the groups in initial oral language ability, and to secure a base 
line to judge growth in oral language during the year. The test 
will be readministered in May at which time the groups will again 
be compared and, in addition, the growth within each group will be 
measured. The initial Oral Language Test results show (Table A-3) 
that the control group at Dalrymple School was again superior to 
either Distar class. The Distar classes* performed equally well. 
It is to be hoped that, if instruction in oral language develop- 
ment is effective, the Distar group will do as well as the con- 
trol group at the end of the year. In addition, the Distar groups 
should do as well as the control group on a reading test given at 
the esid of the year if the Distar program successfully overcomes the 
lag in readiness. 

00 0.31, ■ 



Second Grade Testing 

* A nori-Distar group was established at- £.6* NEWTON in 1972-73 
^nd compared to the Distar group at Newton School in that evalua- 
tion. Selection of children for the Distar and non-Distar classes 
was done in a way that would form two similar groups • The manner 
ol selection of children for Distar instruction at Chase School ^ was 

jidt expected to produce a comparable group. Although the three 

I ' * ' 

groups are compared in Tables A-1 and A-lf, only comparisons of the 

Newton School Distar and control second gr^de classes can yield 

conclusions about the relative eff ectiveness| of the two programs • 

at' second grade level. ■ ' . 

It. was stated in the 1973- report (P» 10) that reading test ° 

scores of the Chjase School Distar group seemed extraordinarily high 

and the question of validity was raised. Reading scores of these 

i 

childreru^ Table k'-k) are examined to resolve the question. 
- ^ Table "A«l shows the two groups at Newton School are equivalent 

in IQ. However, seven children in the control group were tested 
in reading, but no IQ spore was reported. IQ was reported on one 
child who was absent for the reading test. Five children who had 
been part of the Distar group at Newton in 1972-73 ware no longer 
in the group in 1973^7^ • Table A-4 shows the two classes at Newton 
School did not differ significantly on any reading subtest score. 

The question of exceptionally high performance by Chase School 
pupils in 1972-73 was reexamined. ,A comparison oj^^tchievement by 
this group and the other two shows no superlorresults by the Chase 
group in the interim testing (T.abl^A-i4') . Of the original group 
in 1972-73 > one child was not tested in the interim testing. Two 
new children,.. not'' pre ,ent in 1972-73 1 were tested. After excluding 
thiSTse two, mean scores of the seventeen original children tested for 
O „ .this interim evaluation do .not . differ appreciably from the mean scores 

^ 00032 



of. all nineteen reported in Table The Chase, School group in- 

cludes three children who had been transfered to traditional pro- 
grams at the beginning of the year because, of high performance. These 
children were given typewritten copies of the reading test, as. 
was the control group at Newton. All children still receiving 
.instruction with the Distar materials were given hand-le.ttered ver- 
sions using the Distar alphabet form. Table A-4 shows that the Chase 
School- group was in no way superior to the other groups in reading 
performance* 

Self-Concepb Measure 

- # *> 
A measure of attitude about self entitled When Do I Smile? 

was used in November 1973. Groups were compared on this test and , 
will again be compared in May. In addition", im]^ovement in self- 
concept within each group will be assessed in May. Comparison of 
groups on the pretest shows only one significant difference. "Jhe 
comparison of first-grade groups at Chase and Dalrymple favor^ the 
latter (Table A-5; lower scores indicate higher self-cohqefpt) . Un- 
fortunately, almost half the response sheets of one class were in- ^ 
validated by multiple responses or omitted responses. 

P^rant Questionnaire 

Parents of Distar children and control groups (selected classes 
at Newton School) were asked to respond to a questionnaire • 
Responses of parents of boys and of girls at each school and grade 
were rather similarly distributed among the choices, therefore re- 
sponses of boys and girls are combined - no differentiation is made 
by sex in Table A-6.' In most cases questionnaii^es were completed 
by mothers. Of the ninety questionnaires returned, only five were, 
completed by fathers or by both parents. Therefore, no differenti- 
ation is made as to which parent responded. Question 1 asked infer- 



mat ion about child's grade, sex, and which parent :^es ponded. 

Question 2 inquired about interest in reading; . All groups 
.reported that mbst children showed some interest or high interest • 

Question 3 inquired about interest in arithmetic* All groups 
reported that most children showed some interest or high interest • 

Question k inquired about the child's feelings about school* 

All groups generally reported that children enjoyed school* 

/ 

Asked whether the parent was sat.isf ied^^with the child's progress 
in reading (question 5), most responses in /five groups were affirm- 



ati^e. Most parents of children in the first grade Distar class in 

one school responded that they were uncertain. In many of these ^ 

* ' . / 

' ^ ' / 

cases, parents' commented that too little time in the program pre- 
vented them from making a judgment* * • 
-^^Kissing data prevented analysis yof resjponses by; parents of 
second graders to questions 6, 7$ and 8, 

Asked about satisfaction with- progress in arithmetic (question 6), 

/ 

responses were, mainly affirmative in two groups and uncertain in one* 



Again, the response of uncertain was attributed to lack of sufficient 
time to make a judgment. / 

In most cases parents were^ satisfied with the teacher's response 

/ 

to the child and the child's i^elations with other children » (questions 
7 and 8). 

In conclusioQ, there wa^s no group of children whose parents had 

-J 

pr imarll-y -negative' res pons e s" to questions about children's interest. 



progress, and relations to school, teacher, and peers. Neither the 
Distar nor the traditional programs at either first or second grade 



produced a fundamentally negative assessment ^by the parents to any 
of these questions. 



* / 0003 4 



. Conclusions to Intdrim Report 



!• Coraparisori of the first-grade jc^ . ^f^es at Chase, Newton and 



Dalr^ii^je schools 
generally* superior 



il IQ, 



performance of the children at Dalryrnple. This 



oral language, and readiness shows the 



underscores the ne^i^for compensatory services for the children at 
the "two-Title I target schools. 

2. Reading test results of three second-grade classes at 
Title I target schools fail to establish any superiority of Distar . 
or traditional instructrion over the other* There is evidence; from 
classroom observation that second grade instruction of Distar classes 
increasingly consists of an amalgamation of Distar^ aM traditional 
materials and propedures. Effectiveness of instruction during these, 
first two years may result largely from the use of instructional ^ 
ai<ies« If this is so, equally good results can possibly be obtained 
by using an instructional program more flexible than Distar while 
maintaining the use of instructional aides and other support serv^^ces 

3« Attitude measures and parent questionnaires tend to show 
equivalent attitudes about self, school, and the acadejnic skills of 
reading and arithmetic • 
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TABLiS A-1 

COMPARISON OK I>4 SCORES 
JANUARY 1974 









Grade 1 






MTQUV 


N 




\ SD 




P 


•Newton-Distar 


21 


101.7 


17.70 






vs. 








-0.1^5 


NS 


Chase-Distar 


21 


102.4 


11.33 






wewX/On— uls uar 


21 


101.7 


17.70 




• 


V s • 








— ± . 050 




Dalrym.-Gontr. 


26 


109.2 


9.58 






L> r> ^ ' Ti A M 4> #> «A 

onase**uis uai* 


21 


1 no Ll 


ii . 


I 




vs • 










Dalryni.-Contr. 


26 

• 


109.2 


9.58 \ 

\ 










« 


uraae c 






Newt on-Di star 


23 


108.5 


15.08 






' vs. 


2.412 


<.05 


Chase-Distar 


17 ■ 


98.0 


11.20 






Newton-Distar 


23 . 


108.5 


15.08 






vs; 






-0.395- 


NS 


Newton-Control 


20 


110.2 


13.26 






Chase-Distar 


17 


98.0 


11.20 






vs. 








-2.992 


<.01 


Newton-Contror 


20 


110.2 


13.26 , 







TABLE A-2 

COMPARISON OF METROPOLITAN READINESS TEST 
SCORES OF FIRST-GRADERS 
(SEPTEMBER. 1973) 



Group 


N 


Mean 


SD 


t 


P 


Newton-Distar 


20 


50.40 


15.55 






vs. 




11.36 


-0.873 


NS 


Chase-Distar 


22 


54.05 






Newton-Distar 


20 


50.40 


15.55 .• 






vs. 




-3.660 


<.001 


Dalrym.-Contr. 


25 


64.56 


10.32 






chase -D is tar- 


22 


. 5^.05 


11.36 






vs. 






-3* 325 


<.01 


Dalrym.-Contr. 


,25 


64.56' 


10.32 
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TABLE X-3- 



. COMPARISON OP ORAL LANGUAGE TEST 

SCORES OP PIRST-GRADERS 
^ (OCTOBER 1973) 



Groui)...- 


N 


Mean 


•7 SD 


NewtoK-Distar 


21 


7.86 

f www 


2.61 


■ VS.* 








Chase-Distar '. 


20.. 


8.35 


2.18- 


Newtoh-Distar 


21 


7.86 


2.61 


vs. 








Dalrym.-Contr. 


22 


10.18. 

1 


2.52 


Chase-Distar 


20 


8.;35 


2". 18 


vs. 








Dalrym.-Contr. 


.22 


10.18 


2.52 



-0.654 



-2.970 



-2. 506 



NS 



<.01 



<.05 



TABLE A-4 

COMPARISON OP READING SCORES ON 

NEW DISTAR READING TEST 
(SECOND-GRADERS, DXEMBER 1973)", 



Score 



Newton-Distar 



Chase-Dist^ir 





(N = 23) 
Mean & SD 


(N = 19.) 
Mean & SD / 






.Main Idea 

\^ * 


4.48 
1.53 


4.11 
1.37 


0.823 


NS 


Details 


-10.83 
1.27 


9.84 
1.71 


.2.142 


<.05 


Inferences 


4.57 - 
.90 


4.21 
1.18 


1.106 


NS 


Total Reading 


19.87 
3.28 


. 18.16 
3.39 


1.659' 


US ■ 


Score 


Newton-Distar 
(N = 23) 
Mean & SD 


Newton-Control 
(N = 26) 
Mean ft-SD 


t 


. p 


Main Idea 


4.48 

1*53 


■4.0b 

■ ^-n- 


1.084 


NS 


Details 


10.83 
1.27 


10.08 
2.40 


i.34;l 


NS 


Infeirences 

/ • 


4.57 
.90 . 


4.15 
1.26 


1.305 


NS 


Totkl Reading 


19.87 
3.28 


1,8.23 
4.27 


1 .491 


NS 



TABLE A-i* (Continued) 



Scbre 



Chase-Distar 
(N = 19) - 
Mean & SD 



Newton-Contn,ol 

m = 26) 

Mean &, SD 



Main Idea 
Details 
Inferences ■ 
Total Reading 



4.11 
1.37 

9.84 
1.71 

4.21 
•1.18 

18,16 
3.39 



4.00 
1.55 

10.08 
2.40 

4.15 
1.26 

18.23 
4.27 



0.236 NS 

-0.364 NS 

0.153 NS 

-0.062 NS 



X 



. TABLE A-5 

COMPARISON OP GROUPS ON • SELF-CGNCEPT 
MEASURE WHEN DO I SMILE ? 
(NOVEMBER 1973) ■ • 



GrouD 


N 


Mean 


SD 


t 


P 


Gi?ade 1 


Newtpn-Distar 


12 


38.08 


16.60 






vs. 






-0.947 


NS 


Chase-Distar 


21 


42.71 


11.46 






Newton-Distar 


12 


38.08 


16.60 












I.3I8 


NS 


Dalryra.-Contr# 


.23 


32.35 


9.29 






Chase-Distar 


21 


42.71 


11.46- 






vs# 








3. 308 


<.01 


Dalrym#-Contr. 


23 


32:35 


9.29 






Grade 2 


Newton-Distar 


22 


39.06 


12.61 






vs# 






-0.211 


NS 


Chase-Distar 


18 


39.78 


8.33 






Newton-Distar 


22 


39.06 


12.61 












0.259 


NS 


Newton-Control 


25 


38.20 


9.76 






Chase-Distar 


18 


39.78 


8.33 












0.555- 


NS 


Newton-Control 


25 


38.20 


9.76 
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* TABLE A-6 

TALLIES OP RESPONSES TO PARENT QUESTIONNAIRE 



6. Satisfac. jwith 
arith, t>r ogress 

• Ye^ I 



Uncert. 
No 



7 
1 



10 
^^ 

0 



16 
0 
0 



7. Satisfac. with 
teacher behav. to child. 
Yes 12 1^ 



Uncert i 



^kNo 



2 
6 



0 
0 



16 
0 
0 



Question Gr^ide 1 


• Grade 2 


Newton Chase Newton 


Newton Chase -Newton 

i^XoJyCXl i^XObCll WUtiOl"^^ 


2.' interest 
in rdg. 

High 5 ■ 10 9 
Some 6 3 7 
.Low ' k 0 0 


.9 5 , 13 
9 5 5 

0 0 0 


3. interest 
in artth. 

High 6. k 12 

Some . ^ 9 ^ 

Low - 2 • 0 0 


8 5 11 

9 5 6 . 

.1 .0 1 


if. attitude 
to^. school 

Enjoys 10 12 1^ 

Neutral 2 2 2 

Dislikes 10 0 


16 9 17 . 

1 .1 1 
10 0 


5. satisfac. with 
rdg. progress 

Yes 3 12 12 

Uncert. 9 2 3 

No 1 0 1 


16 8 13 
2 2 5 
0 0 0 



8. Satisfac'. with child's relations 
to other cHildren , 

Yes 1 9 10 16 

■ f 

Uncerfc. ^ ^1- 0 

! 

No 1 1 0 0 



ERIC No. of boyj's 8 

No, of frliTls 6 



8 
6 



5 
11 



Jl 



9 
9 



APPENDIX B 



Readministration of Reading Test to Former 
First^raders in October 197^ 



■ I 



1^ 
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.In October 197^$ second -graders (first-graders in 1973-197^) 
were readministered the New Distar Reading. Test in order to re- 
check the ambiguous status of first-grade reading results. This 
step was in keeping with the first recommendation made on page 2k 
of the 1973-^19?^ report. It was thought that results obtained on 
the end-of -first-grade testing may have been caused by non-standard 
procedures of administering the tests to the three first-grade 
classes.^. For this reason, one reading specialist was assigned 
to administer the test to the three secoM-grade classes, ^^^ith 
the assistance of t]ie remedial reading teacher of the respective 
school. 

The results of this testing are shov;n in Table 3-1. The . 
number of children tested in October 197^ in each class is not 
identical to the number ^tes^d in May 197^- In October, no siG;nif- 
icant differences appeared amortg^the classes tested, whereas signif- 
icant differences had occurred in^5a^g^7^t' (Table 3, 1973-197^ report) 
V/hen data were analyzed on only those childi::en^testjed both' in May 
and in October, the significant differences that o<^urred for these 
children on the May testing v^ere on the same comparison^^qn^^ 
significant differences appeared for the total number tested in May, 
whereas in October, only one significant difference was obtained 
(Tables B-2 and B-3). A comparison of the May and October results 
wj.thin each group (Table B-^) shows significant gains made by the 
Newton-Distar group on all 'scores, significant gains made by the 
Dalrymple-control group on two scores, and significant decline made , 
by the Chase-Distar ^roup on two scores. These results suggest 
that non-standard testing procedures were partly responsible for 
the May results. When procedures were standardized, and afte^* 
several months passed in which the children matured and received . 
some additional inst^ruction, the groups, did not differ appreciably 
in reading ability. In conclusion, the Distar reading prograra"..was • 

— — —r^ ' iva-a-A-i- — - — ~ — — 
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judged to be neither ^'better nor wprse than conventional instruction 
given to first-graders. - :; 

■* . , • / _.. .table: b-1 

comparison op scores on octqber 1974 administration op 
new distar 'sead^ing test," all. c hildr en tested 

' ^* ' ' * I 



Scoine , 


Newton-Distar 
(N =19) 
Mean & SD 


Chase-Distar 
(N = 21) 
Mean & SD 


t 




Plain' idea 


2.37 
2.11 


■ 3 •43 
. 1.45 


—J. •Of c 




Details 

> 


6. ,32 ^ 
4,69 


7.00 

3.,00- 


, -0.555 


NS 


Inferences 


- 2.68 
•2.19 ■ 


2.90 
1.30 


-0.392 


•NS 


Total Reading 


11.37 
8.47 


0I3.33 
4.37 . 


-0.935 


NS »■ 


Score 

- 


Newt on-Di star 
(N = 19) 
Mean & SD 


Dalryraple-Control 
(N = 24) 
Mean & SD 


■ t 


• P* 


Hain idea 


2.37 
'2.11 


3.46 
1.56 


c . 

-1 .946 


NS 


Details 


6.32- 
4.69 


8.21 
3.58 


-1.502 ■ 


NS 


Inferences 


2.68 
2.19 ■ 


3.42 

1.53 ^ 


-1.291 


NS 


» 

Total Reading 


11.37 
8.47 


15.08 
6.02 


-1.680 


NS 


Score 

» 


Chase-Distar 
(N = 21) 
Mean & SD 


Dalrymple-Control 

(N = 24) ■ 

Mean & SD ' 






Main Idea 


3.43 
1.43, 


3.46" 
1.56- 


-0.066 


NS.. 


Details 


7.00 
3.00 


8.21 
3.58 


-1.218 


NS 


Inferences , 


2.90 
1.30 


3.42 • 
1.53 


-1.200 


NS 


Total Reading 


13.33 
4.37 


15.08 
6.02. 


-1.101 


•NS 



»MS-= Not Significant 



TABLE B-2 

' ' * ' ' . ' ^ 

COMPARISON- OF SCORES ON MAY 1974 ADMINISTRATION OF 
NEW DISTAR READING TEST FOR CHILDREN TESTED 

IN BOTH MAY AND OCTOBER • i ^- 



Score 0 


Newton-Distar 
(N = 19) 
Mean & SD 


Chase-Distar 
• (N = 19) 
Mean & SD 


t 




Main Idea 


1.32 

1 80 


4.32 

1-11 


-6.195 


<..ooi 


Details 


1.84 
^ 2.61 


.^10.16 
1.42 


-12.194 


<looi 


Inferences 


.95 
1.39 


3.68 
1.25 


-6.374 


<.001 


Total Reading 


4.11 
•4.64 


18.16 
2.41 


-11.713 


<.001 


Score 


Newton-Distar 
(N = 19) 
Mean 4 SD 


DalrymDle-Contrdl 
(N = 22) 
• Mean & SD 


t 


p* 


Main Idea 


1.32 

J- . ou 


■ ■ i 
2.95 

6.5X 

3.08\ 


-3.101 


<.01 


Details 


1-.84 
2.61 


-5.227 


<.001 


Inferences 


.95 
1.39 


3.14 
1.46 


-4.894 


<.001 


Total Reading 


4.11 
4.64 


12.64 
5. 08 


-5.582 


<.001 


Score 


Chase-Distar 
(N = 19) 

Mean ^. SD ■ 


Dal ry mpl e -C ont r ol 
(N = 22) 
Mean & SD 


t 


p^^ 


Main Idea 


4.32 
1.11 


2.95 
1.59 


3.133 


<.01 ' 


Da tails 


10.16 
1.42 ' 


6.55 
3. 08 


4.689 


<.001 


Inferences 


3.68 


3.14 
1.46 


1.281 


NS 


Total Reading 


18.16 
2.41 


12.64 
5.^8 


4.333 


<.boi 



NS''^= Mot Siprnificant 
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TABLE B-3 

COMPARISON OP SCORES ON OCTOBER 197^1- ADMINISTRATION OP 
NEW DISTAR READING TEST POR-> CHILDREN TESTED 



t 


IN BOTH 


MAY AND OCTOBER 








Score ^ 


Newtdn-Disifcar 
(N = 19) 
Mean & SD 


Chase-Distar 
(N = 19) 
[ipan ^ SD 


t 




Main Idea 


2.37 
2.11 


a.63- 

1.26 


-2.239 


<.05 


Details 


6.32 
4.69 ■ 


\ 7.53 
\ 2.61 

\ 


-0.983 


NS ■ 


Inf ererjLces 


2.68 
2.19 


■\'2.95 ' 
\l.-35 


-0.446 


NS 


Total Reading 


11.37 


14.11 


-1.291 


NS 


Score 


Nev^ton-Distar 
(N = 19) 

Mean ^ SD ^ 


Dalrymple-Control 
(N = 22) * 
Mean & SD 


t 




Main Idea 


■ 2.37 
2.11 


3.36 
1.53 


-1.744 


NS 


Details 


6.32 
i^.69 


7.91 
3.58 


-1.231 


NS - 


Inferences 


2.68 
2.19. 


3.32 
1.55 


-1.081 


''NS 


Total Reading 


11.37 
8. '+7 


14.59 
6.05 


-1.415 


'ns 


Score 


Chase-Distar 
(M = 19) 
Mean & SD 


Dal r ympl e -C ont r ol 
(N =^2) 
Mean & SD 


u 


P* 


Mainr^ Idea 


■3.63 . ■ 
1 .26 


3.36 

1.53 


•0.607 


NS 


Details 


7.53 ^ 
2.61.. 


7.91 
3.58 


-0.385 


•NS 


Inferences 


2.95 
1.35 , 


3.32 

' 1-55 . \ 


-0,808 


NS'' «. 


Total Reading 


1^.11 
. 3.70 


14.59 \ 
6.05 


-0.304 


NS 



TABLE B-4 

COMPARISON OF MAY 197^ AND OCTOBER 197^ 
ADMINISTRATIONS OP NEW DISTAR READING TEST 



Score 



Pretest 
Mean & SD 



Posttsst 
Mean & SD 



P* 



Newton-Distar. N = 19 



Main Idea 


1.32 ' 


2.37~ 


' .2.344 


-<.05 




1.80 


2.11 






Details 


1.8^ 


^.32 


4.819 


<.001 




2.61 


4.69 






Inferences 


• ✓ -/ 


2.68 


3.598 


<loi 


0 


1.39 


2.19 






Total Reading 


4.11 


11.37 


4.692 


<.001 




8.47 

> 

^ - 








Chafje-Distar. N = 19 














-1.660 ■ 


NS 




1.11 


1.26 






1/6 UcilX b 


If) 1 ^ ^ ^ 




-3 .773 


<.01 




1.42 


2.61 






XIXI (^1 (^XIUv^O 




2.95 


-1.973 


NS 




1.25 


1.35 










l4.ll 


-4.095 


<.001 


2.41 


3. 70 








- 

Dalrymr)le-C ontr ol , N 


= 22 


1 




Main Idea 


2.95' 


3.36 


1.056 


NS 




1.59 


1.53 






Details 


6.55 ' 


7.91 


2.485 


<.05 




3. 08 


3.58 






Inferences 


3.14 


3.32 


0.748 


NS- 




1.46 


^ 1-55 






Total Reading 


12.64 


14.59 


2.506 


<.05 


, 5.08 


6.05 






*NS = Not Sir:n 


if loan t 
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